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Abstract — An algorithm for constructing Tanner graphs of non- 
binary irregular quasi-cyclic LDPC codes is introduced. It employs 
a new method for selection of edge labels allowing control over the 
code's non-binary ACE spectrum and resulting in low error-floor. 
The efficiency of the algorithm is demonstrated by generating good 
codes of short to moderate length over small fields, outperforming 
codes generated by the known methods. 

I. Introduction 

LDPC codes introduced by Gallager JT| are excellent error 
correcting codes, which are being used in many modern ap- 
plications. Non-binary (NB) LDPC codes exhibit better error 
correcting performance compared to the binary ones (2j. As 
the field size grows, error correcting capability improves, at the 
price of increasing decoding complexity. 

Binary LDPC codes constructed by quasi-cyclic (QC) lifting 
of a base-graph have a structure that can be utilized in an 
efficient implementation of both the encoder and the iterative 
decoder (3), J4), (5). NB QC codes based on a-multiplied 
circulant permutation matrices have similar properties J6). 

In LDPC codes, the error-floor is induced by the presence 
of small combinatorial structures in the Tanner graph (e.g. 
stopping-sets, trapping-sets, etc.). These structures always con- 
tain cycles, therefore manipulating the parameters of the cycles 
also affects the error-floor. The parameters of importance here 
are the cycles' length and connectivity, manifested by their 
approximate cycle extrinsic message degree (ACE). For binary 
codes, the error-floor can be reduced significantly by removing 
short cycles having small ACE value from the graph [71, [8], [9|, 
ifTUl . For QC codes, the ACE-constrained construction becomes 
more computationally efficient by utilizing the relation between 
cycles in the protograph and their realization in the lifted graph. 
Based on this idea, Asvadi et q/. lfTTI introduced an algorithm 
for design of irregular binary QC codes with an excellent error- 
correcting performance. 

NB LDPC codes are conventionally constructed by first 
obtaining a binary mother parity check-matrix H^, and then 
replacing the non-zero elements of Hi, by non-zero values from 
the field, often referred to as labels. The label assignment is 
performed either randomly or intelligently (by meeting some 
design criteria). 

Poulliat et al. [8| designed regular NB (2,d c ) codes (cy- 
cle codes) by first using the progressive edge growth (PEG) 
algorithm [12] to construct Hi, having an associated Tanner 
graph with large girth. Then, they introduced a method for label 



assignment based on cycle cancelation, resulting in low error- 
floor codes. Peng and Chen extended this idea for the the design 
of NB QC regular cycle codes [ 13 1. Other design algorithms for 
NB QC codes were also explored recently IT4l lfl5l . 

In this paper, we use a relation between the protograph and 
the QC lifted graph, to produce good irregular NB QC LDPC 
codes. Our design involves a new method to select edge labels 
which constrain the code's NB ACE spectrum, resulting in 
improved performance. We demonstrate the efficiency of this 
algorithm by constructing good codes of short to moderate 
length over small fields. Such codes are practical due to their 
moderate decoding complexity. Note, that irregular profiles 
achieve better error correcting performance compared to regular 
ones for codes over small fields J3] lfl2l . which motivates our 
ACE based design. 

The paper is organized as follows. In Section III] we begin 
by presenting the relevant background and notations that are 



used throughout. In Section III we present our NB QC code 



construction method. The performance of codes generated by 
the method is demonstrated by simulations in Section [IV] 

II. Preliminaries 

Throughout we use the following notations. For an integer 
n > 0, let [n] = {1,2, . . . ,n}. For two integers a, b, the 
remainder of the division of a by & is denoted by Rb[a\. For 
two vectors u, v of length I, u > v iff ui > Vi , Vi £ [£] . 
A. LDPC Codes 

A binary LDPC code of length n is a linear block code 
defined by a binary parity -check matrix H mxn . The code 
can be equivalently represented by a bipartite Tanner graph 
G = (V U C,E), where the set V consists of variable nodes 
v.i, i £ [n], and the set C consists of check nodes c,-, j £ [m]. 
An edge connects a variable node Vi to a check node Cj iff 
Hji = 1. The degree distribution of the code is represented by 
two polynomials: A(x) — Xh=2 A* a; 8 f° r ^ e var i a ble nodes and 
r(#) = X)j=2 ^ iX% f° r ^ e check nodes, where d v {d c ) is the 
maximum variable (check) node degree, and where Aj (rj) is 
the number of degree i variable (check) nodes. If A(x) = n-x d,J 
and r(x) = m ■ x d ", the code is called regular (d v ,d c ) LDPC. 
Otherwise, the code is called irregular LDPC. 

An NB LDPC code over GF(q) is defined by a parity-check 
matrix H with elements from the field (q = 2 r , r > 1). The 
Tanner graph of the code has labels on its edges which are the 
corresponding non-zero entries from H. For such a code, we 



define a binary matrix Hf, of the same dimensions as H, such 
that each entry in H^ is 1 iff the corresponding entry in H is 
non-zero. Hj, is referred to as the binary mother matrix of the 
code. 

B. QC Lifted Codes 

Definition 1 (Lifted graph): Let G = (f U C,£) be a 
Tanner graph. For each (v, c) E E define a permutation Trt VlC \ 
on the set [Z]. To each v E V (c E G) we generate a set 
of Z duplicates v t (a), i E [Z]. Then G = (V U C,E) is 
a Z-lifted graph of G, associated with these permutations, if 
V = {vi\v e V,i e [Z]}, G = {c 4 |c eC.ie [Z]} and 
£ = |(vi,c,-)|(u,c) e E [\K (lKc) {i) =j\. 

The graph G is called a base-graph or a protograph. When 
all the edge permutations in G are cyclic shifts of [Z], then 
G is called Z-lifted QC graph. In this case, a binary LDPC 
code associated with G, has a compact block-representation of 
its parity check matrix H, based on the parity check matrix 
H associated with the protograph. In this representation, each 
entry is replaced by a Z x Z matrix as follows. The zero entries 
are replaced by zero matrices. Each non-zero entry is replaced 
by a (Z, d)-circulant permutation matrix (CPM), defined below, 
if a right circular shift of d places is assigned to it. 

Definition 2 (CPM): A (Z, d)-CPM is formed by a circular 
shift to the right by d places of the columns of the Z x Z 
identity matrix. 

In an NB QC Z-lifted code, each non-zero element of the 
protograph parity check matrix, corresponding to an edge e, 
is replaced by a (Z, A e ,p e ,d e ) -multiplied CPM (MCPM), as 
defined below l6l. lIBl. 

Definition 3 (MCPM): Let (q — 1)|AZ and a is a primitive 
element of GF(q). A (Z, A, p, d)-MCPM over GF(q), is a Z x 
Z matrix, with underlying binary mother matrix (Z, d)-CPM. 
Furthermore, for each row i of the MCPM i E [Z], the single 
non-zero element is a p+ ( l ~ 1 )' A . 

Note, that in a CPM, each row is an a A -multiplied circular right 
shift of the row above it. This is also true for the first row, where 
the row "above it" is defined to be the last row. 

C. Cycles and ACE 

Cycles in the Tanner graph are known to influence the error- 
floor of iterative decoders (e.g. stopping-sets, trapping-sets, 
etc.). Important combinatorial characteristics of a cycle are its 
length and its extrinsic message degree (EMD), which is the 
number of check-nodes that are connected to the variables of 
the cycle by only one edge. In this paper, we use for simplicity, 
the approximate cycle EMD (ACE), defined as z^, v .(d Vi — 2), 
where d v is the degree of a node v, and the summation is over 
all the variable-nodes of the cycle. A code with long cycles and 
large ACE usually exhibits smaller error-floor compared to a 
code with shorter cycles or smaller ACE. This notion motivates 
the following definition. 

Definition 4 (ACE spectrum): For an LDPC code repre- 
sented by a Tanner graph G, the ^-depth ACE spectrum is 



minimum ACE value of any cycle of length i in G. G achieves 
an ^-depth ACE constraint 
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To lower error-floor, it is beneficial to achieve higher ACE 
spectrum values for cycles of lower length. 

We now discuss the relationship between cycles in the 
protograph G and the resultant QC Z-lifted graph G Let C 
be a cycle in G of even length £, being a sequence of edges 
{e{\ i=1 , having ACE r. Assume that in G, for each edge e; 
we used a (Z, dj)-CPM, i E [£]. The order of C in G is defined 
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as O(C) = Z/gcd(Z,d), where d = R z 
called the total shift of the cycle C. It is easy to see that 
lifted nodes and edges of C in G form a union of gcd(Z, d) 
cycles, each one of them having length £ ■ 0(C) and ACE 
t • 0(C). Moreover, every cycle in G corresponds to a cycle 
in G. Therefore, the ACE spectrum of G can be easily derived 
from the knowledge about cycles in G and the shifts of its 
edges. 

In NB LDPC codes each cycle also has a meaningful alge- 
braic structure, defined by the labels on its edges. A simple 
and minimal cycle (i.e. that does not contain a cycle being a 
subset of its nodes), C, of length £ in an NB Tanner graph G, 
with parity check matrix H can be represented by an £/2 x £/2 
matrix denoted B. Here, B is the sub-matrix of H with rows and 
columns that correspond to the check nodes and variable nodes 
that are in C. Without loss of generality, we can assume that 
B has the following canonical form. The ith row, i E [£/2 — 1] 
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where t ■ , i < £, is the 



isof the form [0i_i,^ 2 (i-i)>P2(i-i)+i)' 
row is [0t-i,Ot/2-2,0t-2\- Here, for i > 0, 0. ( , is the zero- 
vector of length i (in case i = 0, this is the empty vector) and 
{Pi}iZo are non-zero elements of GF(q). 

In LDPC cycle codes, studied by Poulliat et al. [8|, the 
variable nodes of every simple and minimal cycle form support 
of a codeword, unless its corresponding matrix B is full-rank. 
In a canonical form of B, this full-rank condition (FRC) is 
equivalent to the following 

f/2-l £/2-l 

(FRC) : J] /3 2i+1 jt J] p 2i . (1) 

j=0 i=0 

Therefore, to avoid low-weight codewords in cycle codes 
(causing high error-floor), Poulliat et at, assign the labels of 
the NB code, so that cycles of short length fulfill the FRC. A 
cycle C, that satisfies the FRC is said to be "canceled^. 

We argue that even for general NB irregular codes, assigning 
labels such that a cycle C is canceled, should reduce the 
probability that the BP iterative decoder fails to converge due 
to errors in the variables of the cycle. The intuition behind it is 
that the constraints of the matrix B corresponding to C, imply 
a local-code on the variables of C with a single codeword (the 
zero-codeword) iff C is canceled. Since the iterative decoder is 
local in its behavior, if C is not canceled, the decoder could 
be misled to converge to one of the wrong codewords of the 
local-code of C. The cycle's extrinsic check nodes may prevent 
such an erroneous convergence. Having more such extrinsic 



check nodes should increase the chance to overcome errors in 
the variables of C. Hence, because label assignment can cancel 
only a limited number of cycles, it seems reasonable to prefer 
canceling the shorter ones with low ACE. This notion justifies 
the next useful definition. 

Definition 5 (NB ACE spectrum): For an NB LDPC code, 
represented by a Tanner graph G, the ^-depth NB ACE spectrum 
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is the minimum ACE value of any non-canceled cycle of 
length i in G. G achieves an £-depth NB ACE spectrum 
-(nb) = {^ nb \ri nb) ,..,T { e nb) } if T^ nb \G) > r {nb \ 

Peng and Chen [13| showed that for NB QC Z-lifted codes, 
the FRC of the lifted-cycles resulting from a protograph cycle C 
can be simply expressed through the parameters of the MCPMs 
assigned to the edges of C. 

Theorem 1 ( j|7?l/): Suppose a simple and minimal cycle C 
of length £ on the protograph is represented by a matrix B in 
its canonical form. Let B be the QC Z-lifted representation of 
B / P Pi ... \ 
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where Pi is (Z, A,pi,dj)-MCPM. The FRC condition for the 
cycles induced by C in the lifted graph (each one of length 
0(C) ■ £) is 



0(C)- £ (-1) WO mod(g-l). 



(3) 
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Note, that Peng and Chen required that (q — 1) = Z ■ A, 
however their proof is still valid even in a more general case 
of (q — \)\Z ■ A. The combinatorial and algebraic connections 
between the cycles of the protograph and the cycles of the lifted- 
graph, are a key to the efficient algorithms we present in the 
next section. 

III. Non-Binary QC ACE Constrained Code 
Construction 

In this section, we introduce a code construction algorithm. 
The inputs to the algorithm are the degree profile of a 
protograph G, a lifting order Z and a field size q. The 
algorithm is also given two £-depth ACE spectrum constraints, 

i(b) _ ,^(b) ~(b)^ „ H *.(nb) _ (~(nb) 



L (nb), 



r- - = (f 2 w , . . . , ?F) and T (nD) = (f 2 ^, . . . , ff">), such 
that t^ > fW. The output is G, a QC ^-lifting of G with 
labels from GF(q) \ {0}, which is NB ACE constrained by 
j- (nb) an( j j ts binary mother matrix is ACE constrained by f w, 
if both spectrums are achievable. The algorithm consists of the 
following steps: 

Step 1: Construct a good protograph G by any protograph 
selection method (e.g [9]). 

Step 2: Construct a QC Z-lifted graph of G, that is t (6) -ACE 
constrained, by carefully choosing for each edge of G the 
cyclic shift of its Z copies (see Subsection |III-A) >. This graph 
is the binary mother matrix of the output G. 



Step 3: Assign labels to the edges of the mother matrix, such 
that the resultant NB labeled graph G is NB ACE constrained 
by T^ n '. This label assignment ensures that all the cycle s in 
G that violate r' n satisfy the FRC (see Subsection 



III-B i. 



Good achievable constraint vectors f^ , f^ n ' and their depth 
£ may be found by the following heuristic search. Find initial 
constraints t*- ', f^ n ' by first running the above algorithm with 
no constraints, and retrieve the spectra of the resultant graph G. 
Then, attempt to improve the spectra by increasing their depth £ 
or increasing their components and rerun the algorithm with the 
amended spectrum. Repeat this procedure (amending the spectra 
and rerunning the algorithm) until no further improvement is 
achieved (i.e. the algorithm fails to find a graph that achieves 
the constraints). Note, that since it is not always possible to 
determine which spectrum is better (see e.g. J9] Section IV]), 
the designer is advised in these cases, to generate graphs for 
each of these competing spectra and choose the best one by a 
simulation. Furthermore, because of the random nature of the 
algorithm, it is recommended to run the algorithm several times 
for each set of good parameters, thereby generating different 
instances of G satisfying the requirements. Here, again, the best 
instance, may be chosen by a simulation. 

A. Construction of the Binary Mother Matrix 

We now describe an algorithm that finds a QC binary code 
that satisfies certain ACE spectrum constraints. The inputs to 
the algorithm are a protograph G, a lifting factor Z and an 
ACE spectrum constraint vector r' ' = (fg ,74 ,--,t' { \ )■ 
The algorithm searches for a QC Z-lifted code with Tanner 
graph G which achieves r' \ G is defined by assigning a cyclic 
shift d e G [Z] to each edge e of G. 

We begin by a preliminary step in which we find all the 
problematic cycles of G which violate t' '. Denote this set 
of problematic cycles by S. The lifted versions of the other 
cycles of G will satisfy the t^ ' constraint for any choice of 
shifts. Next, for each edge e of G we enumerate the problematic 
cycles which include e. We arbitrarily choose initial assignments 
of d e for each edge e of G (it is recommended to draw these 
assignments uniformly at random). 

The generation of G is iterative. In each iteration, we scan 
all the edges of G in an arbitrary order. For each edge e, we 
choose a shift d e 6 [Z] that minimizes the number of cycles 
in S which still violate the t^ ' constraint. If by the end of 
the iteration, all the lifted versions of the cycles in S satisfy 
t' , the algorithm outputs G, otherwise, another iteration may 
be initiated. Note, that there is no guarantee that the algorithm 
finds G that achieves r^ ' even if such G exists. If after a 
predefined number of iterations G is not found, the designer 
may consider choosing a different initial assignment of the shifts 
d e or changing the order in which the edges are visited, and 
repeat the iterative part of the algorithm. Our experience shows 
that usually when G exists, it is found after a small number of 
iterations. 

Our method differs from the algorithm of Asvadi et al. ifTTI . 



[16 1 in the following aspects. In [16; Algorithm 1], the cycles 
in S are sequentially scanned and for each cycle, the shifts d e 
of the "unshifted edges" are assigned whereas in our method, 
the objects being treated are the edges. Furthermore, we allow 
reassignment of d e in case the ACE spectrum constraint was 
not satisfied after the first iteration. Our experience indicates 
that in many cases our proposed algorithm finds G faster than 
ifTBI Algorithm 1]. Peng and Chen lfl3l . suggested to find the 
binary lifted graph G of cycle codes, having girth I. Note, that 
this is equivalent to having ACE spectrum constraints r^ ' such 
that t\ ' — oo for all i < I. Such a spectrum can be achieved 
only for relatively small £, As a result, longer cycles with low 
ACE are ignored. Our results indicate that these cycles have an 
impact on the code's performance in the error-floor region. 

B. Non-Binary ACE Constrained Label Assignment 

We now describe the label assignment algorithm to the entries 
of the binary mother matrix. The inputs to the algorithm are the 
QC Z-lifted graph G (associated with the binary mother matrix) 
expressed as the underlying protograph G and the selected shifts 
of its edges. Additional inputs are the NB ACE constraint vector 
T^ n ' and the field size q. The output of the algorithm is an NB 
QC code over GF{q) that satisfies T (nb) . 

The structure of the algorithm is very similar to the one 
presented in the previous subsection, therefore we only highlight 
here the differences between them. We begin by enumerating 
the set S of problematic cycles in G. This time a cycle is 
problematic if its Z-lift in G violates t^" \ For each edge 
e in G we choose an initial label p e (preferably at random). 
We then run the iterative part of the algorithm from Subsection 
|III-A| in which we assign labels p e (instead of shifts). Note that, 
in this case, a problematic cycle violates t^ n ' if its labels do 
not satisfy ([3]). 

The algorithm we described can be seen as a generalization of 
the method suggested by Peng and Chen [13| for construction 
of NB QC lifted graphs of cycle codes. In their algorithm, all 
cycles up to length I are canceled, which is equivalent to using 
our algorithm with r n ' such that fj = oo for all i < L 
Furthermore, we allow a more flexible choice of the lifting order 
Z and the CPM parameter A, by only requiring that (q— 1)\ZX 
(Peng and Chen's requirement is that Z\(q — 1) and A = (q — 
l)/Z). 

IV. Simulation Results 

In this section, we compare the error correcting performance 
of codes generated by the following techniques: PEG - PEG 
generated mother binary matrix of an irregular code with 
randomly selected labels [12|. REG - PEG generated mother 
binary matrix of a regular cycle code (d v = 2,d c = 4) with 
selective choice of NB labels using the FRC g|. GIRTH - the 
QC construction presented by Peng and Chen ifPUl modified to 
produce irregular codes, where only the girth requirements are 
taken into account. ACENB - our algorithm from Section III 
ACEB - our algorithm ACENB in which Step 3 is replaced by 
random edge label assignment. 



All the codes are simulated over a memoryless binary input 
AWGN channel using the BPSK modulation and decoded by the 
iterative NB belief-propagation (BP) algorithm. The maximum 
number of BP flooding iterations is fixed to 80. All the generated 
codes are of rate 1/2, and their ensemble properties are summa- 
rized in Table II] The degree distributions are selected according 
to Hu et al. |[12| . Note, that A(x) and T(x) are degrees profiles 
of the protograph and Z is the lifting order, resulting in an 
ensemble of QC codes of the specified length in bits. For each 
ensemble, we use a single protograph matrix (Step 1 in Section 
pB throughout the various generation methods. 

In Table In] the achieved ACE spectra are summarized. For 
the codes, generated by ACENB and GIRTH, two spectra are 
provided. The first one is the spectrum achieved by the binary 
mother matrix (Step 2 in our code construction). The second 
one is the NB ACE spectrum achieved by the edge labels 
assignment (Step 3 in our code construction). For the codes 
generated by ACEB, only one spectrum is provided, since the 
random label assignment does not take into account any NB 
ACE spectrum requirement. The achieved ACE spectrum of 
the codes generated by GIRTH, depends only on the codes' 
girth, while the NB ACE spectrum depends only on the canceled 
cycles' length. Note that the achievable ACE spectrum values 
grow with the code length. 
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Field 


Length [bits] 


A(x) 


T(a-) 


Z 


1 


GF(16) 


504 


10a: 2 + 2a 3 + 2a 4 


4 , e 5 
X + OX 


9 


2 


GF(8) 


1008 


10a; 2 + 3x 3 + 3a 4 


7x 5 + x 6 


16 


3 


GF(16) 


1008 


10a; 2 + 2x 3 + 2x i 


x + 6a J 


18 


4 


GF(16) 


1512 


10a: 2 + 2a; 3 + 2a; 4 


4 i c 5 

x + ox 


27 



TABLE I 

Ensemble properties of the generated codes 



# 


GIRTH 


ACEB 


ACENB 


1 


Ti 


— oo, i < 6 

— oo, i < 8 


(oo, oo, oo, 4) 


(oo 
(oo 


oo, oo, 4) 

oo, oo, oo, oo, 4) 


2 


Ti 

Ti 


— oo, i < 8 

= oo,z < 10 


(oo, oo, oo, 5, 2) 


(oo 
(oo 


oo, oo, 6, 2) 
oo, oo, oo, 6, 2) 


3 


Ti 
Ti 


— oo, i < 8 
= 00,2 < 10 


(oo, oo, oo, oo, 3, 1) 


(oo 
(oo 


oo, oo, oo, 3, 1) 

oo, oo, oo, oo, 6, 2) 


4 


Ti 
Ti 


— oo, i < 8 
= oo,z < 10 


(oo, oo, oo, oo, 4, 2) 


(oo 
(oo 


oo, oo, oo, 4, 2) 
oo, oo, oo, oo, 9, 3) 



TABLE II 

ACE SPECTRA ACHIEVED BY EACH OF THE GENERATED CODES. FOR 

COLUMNS ACEB AND ACENB, THE SPECTRUM'S FORMAT IS 

(t2,"T4,t B ,...). 

In Figure [T] the block error rate (BLER) curves of codes from 
ensembles #2 and #3 from Table II] are depicted. As expected, 
the regular code generated by REG is inferior to the other 
irregular codes. Furthermore, even though the code generated by 
PEG is not constrained by the QC requirement, its performance 
in the high SNR region is worse than our QC codes. For 
each ensemble, it's evident that the code generated by ACENB 



■v;;:v 



> 


3F(16)REG 


— 1 — 


3F(16) PEG 


— H~ 


3F(B) GIRTH 


-&■- 


3F(B) ACENB 


— B — 


3F(1B) ACEB 


o 


3F(16) ACENB 



:„^, 



Eb/NO|dB] 




Eb/NO[dB] 



Fig. 1. Simulation of codes having length n b = 1008 and rate 1/2, constructed Fig. 2. Simulation of rate 1/2 codes having lengths around n b = 512 and 
by various methods over GF(8) and GF(16) n 6 = 1504 over GF(16) 



outperforms the codes generated by the other methods in the 
high SNR region. Since the codes generated by ACEB and 
ACENB have the same binary mother matrix, the error curves 
highlight the advantage of applying Step 3 in ACENB instead 
of random label assignment. Also, with the increase of the field 
size, we see an improvement in the high SNR region. 

In Figure [2] the BLER curves of codes from ensembles #1 
and #4 from Table II] are depicted. We also give as a reference 
the BLER curve of L20R32A, a QC code recently generated 
by Chang et al. (14, Figure 10]. Note that, the performance of 
the code generated by REG agrees with the results of Poulliat 
et al. [8 Figure 4], which is simulated using 1000 as the 
maximum number of BP iterations. To have a fair comparison 
with the latter code, we use the same limitation on the number of 
iterations for the codes from ensemble #4. The curves indicate 
that codes generated by ACENB outperform the other codes 
with similar lengths in the high SNR region. Furthermore, 
the comparison of the curves corresponding to ACENB and 
GIRTH indicates the advantage of ACE driven construction of 
NB codes. 

V. Summary and Conclusions 

We presented an algorithm to design the Tanner graph of NB 
QC LDPC codes using ACE constraints for both the generation 
of the binary mother matrix and the selection of NB labels. Our 
simulation results indicate that codes generated by this method 
outperform codes generated by known methods, for different 
small field sizes and code lengths. 

Our method is composed of three separate steps. It is an 
open question whether combining could be beneficial. This is 
a matter for future research. 
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